Ultrasound observation device, processing device, method of operating ultrasound observation device, and computer readable recording medium

ABSTRACT

A processing device includes a controller including hardware. The controller is configured to execute: generating an ultrasound image based on an ultrasound signal acquired by an ultrasound probe, the ultrasound probe being configured to transmit an ultrasonic wave to a subject that is an observation target and receive an ultrasonic wave reflected by the subject; generating shift information including a shift direction of a display area of the ultrasound image displayed on a display unit in accordance with a command position with respect to the ultrasound image; shifting the ultrasound image in accordance with the shift information; and generating a character image indicating an area targeted for a process performed on the ultrasound image in relation to the command position in the ultrasound image after being shifted.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of PCT international application Ser.No. PCT/JP2016/081348 filed on Oct. 21, 2016 which designates the UnitedStates, incorporated herein by reference, and which claims the benefitof priority from Japanese Patent Applications No. 2015-246697, filed onDec. 17, 2015, incorporated herein by reference.

BACKGROUND

The present disclosure relates to an ultrasound observation device thatobserves an observation target by using ultrasonic waves, a processingdevice, a method of operating the ultrasound observation device, and acomputer readable recording medium.

Ultrasonic waves are sometimes used to observe the characteristics of aliving tissue or material that is an observation target. Specifically,ultrasonic waves are transmitted to the observation target andpredetermined signal processing is performed on ultrasound echoesreflected by the observation target so that the information related tothe characteristics of the observation target is acquired.

Ultrasound diagnostic devices with an ultrasound transducer provided inthe distal end of an insertion unit are used for diagnosis of livingtissues, or the like, inside a body to which ultrasonic waves areapplied. In ultrasound diagnostic devices, an ultrasound transduceracquires ultrasound echoes, and a monitor displays acquired ultrasoundimages in chronological order.

An operator such as a doctor inserts an insertion unit into the insideof a body and then operates an operating unit at hand while conductingdiagnosis on the basis of information (ultrasound image) based onultrasound echoes. Here, the operator diagnoses ultrasound images bymaking command input for a process to set an observation area, ameasurement process, or the like. For example, on an ultrasound image,command inputs are made for two measurement points for measuring adistance, and the distance between the measurement points is measured.As a diagnosis system for conducting diagnosis as described above, atechnology for directly making command input to ultrasound images byusing a touch panel is disclosed (for example, see Japanese Laid-openPatent Publication No. 2012-19824). According to Japanese Laid-openPatent Publication No. 2012-19824, a process is performed to display animage including a touch button indicating the position that correspondsto a touch position of a finger of the operator and a caliper that isadjacent to the touch button and that indicates a command position onthe image. Thus, it is possible to perform operation such as adjustmenton a command position while the visibility of a command position(caliper) is retained without hiding the command position with thefinger of the operator.

SUMMARY

A processing device according to one aspect of the present disclosureincludes a controller including hardware, wherein the controller isconfigured to execute: generating an ultrasound image based on anultrasound signal acquired by an ultrasound probe, the ultrasound probebeing configured to transmit an ultrasonic wave to a subject that is anobservation target and receive an ultrasonic wave reflected by thesubject; generating shift information including a shift direction of adisplay area of the ultrasound image displayed on a display unit inaccordance with a command position with respect to the ultrasound image;shifting the ultrasound image in accordance with the shift information;and generating a character image indicating an area targeted for aprocess performed on the ultrasound image in relation to the commandposition in the ultrasound image after being shifted.

The above and other features, advantages and technical and industrialsignificance of this disclosure will be better understood by reading thefollowing detailed description of presently preferred embodiments of thedisclosure, when considered in connection with the accompanyingdrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram that illustrates a configuration of anultrasound diagnosis system according to a first embodiment;

FIG. 2 is a flowchart that illustrates a measurement process performedby the ultrasound diagnosis system according to the first embodiment;

FIG. 3 is a flowchart that illustrates a measurement-point confirmationprocess performed by the ultrasound diagnosis system according to thefirst embodiment;

FIG. 4 is a diagram that illustrates the measurement-point confirmationprocess according to the first embodiment;

FIG. 5 is a diagram that illustrates the measurement-point confirmationprocess according to the first embodiment;

FIG. 6 is a diagram that illustrates the measurement-point confirmationprocess according to the first embodiment;

FIG. 7 is a diagram that illustrates the measurement-point confirmationprocess according to the first embodiment;

FIG. 8 is a diagram that illustrates the measurement-point confirmationprocess according to the first embodiment;

FIG. 9 is a diagram that illustrates the measurement-point confirmationprocess according to the first embodiment;

FIG. 10 is a diagram that illustrates the measurement-point confirmationprocess according to the first embodiment;

FIG. 11 is a diagram that illustrates the measurement-point confirmationprocess according to the first embodiment;

FIG. 12 is a diagram that illustrates a measurement-point confirmationprocess according to a modification 1 of the first embodiment;

FIG. 13 is a diagram that illustrates a measurement-point confirmationprocess according to a modification 2 of the first embodiment;

FIG. 14 is a diagram that illustrates the measurement-point confirmationprocess according to the modification 2 of the first embodiment;

FIG. 15 is a diagram that illustrates a measurement-point confirmationprocess according to a modification 3 of the first embodiment;

FIG. 16 is a block diagram that illustrates the configuration of anultrasound diagnosis system according to a second embodiment;

FIG. 17 is a diagram that illustrates a character-image display processaccording to the second embodiment;

FIG. 18 is a block diagram that illustrates the configuration of anultrasound diagnosis system according to a third embodiment;

FIG. 19 is a diagram that illustrates a measurement-point confirmationprocess according to a third embodiment; and

FIG. 20 is a diagram that illustrates the measurement-point confirmationprocess according to the third embodiment.

DETAILED DESCRIPTION

With reference to attached drawings, an explanation is given below of anaspect (hereinafter, referred to as “embodiment”) for implementing thepresent disclosure. In the following explanation, an ultrasounddiagnosis system and an ultrasound endoscope system including a medicaldiagnostic apparatus that generates ultrasound images based onultrasound echoes are described; however, the embodiment is not alimitation on the present disclosure. Furthermore, the same componentsare attached with the same reference numeral in explanation.

First Embodiment

FIG. 1 is a block diagram that illustrates a configuration of anultrasound diagnosis system according to a first embodiment. Anultrasound diagnosis system 1 illustrated in FIG. 1 is a device thatobserves an observation target by using ultrasonic waves and thatincludes a processing device according to the present disclosure.

The ultrasound diagnosis system 1 includes an ultrasound probe 2 thatreceives ultrasound echoes reflected after ultrasonic waves are output;a processing device 3 that generates images based on ultrasound echoesacquired by the ultrasound probe 2; an operating device 4 that iscapable of simultaneously receiving multiple pieces of input commandinformation and outputs the received information to the processingdevice 3 to operate the processing device 3; and a display device 5 thatdisplays various types of information including images generated basedon ultrasound echoes by the processing device 3. The display device 5 isimplemented by using a display panel such as a liquid crystal or organicelectro luminescence (EL). According to the present embodiment, theprocessing device 3 and an operating device 4 constitute an ultrasoundobservation device 10.

An ultrasound transducer 21 that outputs ultrasound pulses to theobservation target and receives ultrasound echoes reflected by theobservation target is provided at the distal end of the ultrasound probe2.

Here, if the observation target is a living tissue, the ultrasoundtransducer 21 may have any of the configurations as an extracorporealprobe that emits ultrasonic waves from the body surface of a livingbody, as a miniature ultrasound probe including an insertion unit with along axis that is inserted into a lumen such as digestive tract,biliopancreatic duct, or blood vessel, and as an ultrasound endoscopefurther including an optical system in an intraluminal ultrasound probe.Among them, when the configuration of an ultrasound endoscope is used,the ultrasound transducer 21 is provided at the distal end side of theinsertion unit of the intraluminal ultrasound probe, and theintraluminal ultrasound probe is removably connected to the processingdevice 3 at the proximal end side.

The ultrasound transducer 21 converts electrical pulse signals receivedfrom the processing device 3 into ultrasound pulses (sound pulsesignals) and converts ultrasound echoes reflected by an externalspecimen into electrical echo signals. With regard to the ultrasoundtransducer 21, the ultrasound transducer may conduct scanningmechanically or a plurality of ultrasound transducers may conductscanning electronically. According to the first embodiment, anexplanation is given of a case where a radial-type ultrasound transduceris used.

The processing device 3 includes a transmitting/receiving unit 30, asignal processing unit 31, an ultrasound-image generating unit 32, acalculating unit 33, a character-image generating unit 34, an imagesynthesizing unit 35, a mode setting unit 36, an input unit 37, acontrol unit 38, and a storage unit 39.

The transmitting/receiving unit 30 transmits and receives electricsignals to and from the ultrasound transducer 21. Thetransmitting/receiving unit 30 is electrically connected to theultrasound transducer 21 so that it transmits electric pulse signals tothe ultrasound transducer 21 and receives echo signals that are electricreception signals from the ultrasound transducer 21. Specifically, thetransmitting/receiving unit 30 generates electric pulse signals on thebasis of a predetermined waveform and transmission timing and transmitsthe generated pulse signals to the ultrasound transducer 21.

The transmitting/receiving unit 30 amplifies echo signals. Thetransmitting/receiving unit 30 conducts sensitivity time control (STC)correction to amplify echo signals having a larger receiving depth witha higher amplification factor. After conducting processing such asfiltering on amplified echo signals, the transmitting/receiving unit 30conducts A/D conversion to generate digital high-frequency (RF: radiofrequency) data in time domain and outputs it.

The signal processing unit 31 generates digital B-mode reception databased on RF data received from the transmitting/receiving unit 30.Specifically, the signal processing unit 31 performs known processingsuch as bandpass filtering, envelope detection, or logarithmicconversion on RF data to generate digital B-mode reception data. Forlogarithmic conversion, RF data is divided by the reference voltage, andthe common logarithm of a resultant is represented by a decibel value.The signal processing unit 31 outputs the generated B-mode receptiondata to the ultrasound-image generating unit 32. The signal processingunit 31 is implemented by using various types of arithmetic circuitssuch as a central processing unit (CPU).

The ultrasound-image generating unit 32 generates ultrasound image databased on B-mode reception data received from the signal processing unit31. The ultrasound-image generating unit 32 performs image processingusing a known technology such as gain processing or contrast processingon B-mode reception data and decimates data that corresponds to a datastep width defined based on the display range of an image on the displaydevice 5, or the like, thereby generating B-mode image data. B-modeimages are gray-scaled images in which the values of R (red), G (green),and B (blue), which are variables when the RGB color system is used as acolor space, are identical.

The ultrasound-image generating unit 32 performs coordinates conversionon B-mode reception data from the signal processing unit 31 to rearrangea scan area so as to be properly represented in space and then performsan interpolation process on the B-mode reception data to fill gaps inthe B-mode reception data, thereby generating B-mode image data. Theultrasound-image generating unit 32 outputs the generated B-mode imagedata to the image synthesizing unit 35.

After receiving a command input from the operating device 4, thecalculating unit 33 performs a calculation process in accordance withthe command input. Specifically, the calculating unit 33 conductsposition calculation for the display position of a character image(e.g., a measurement point) in an ultrasound image in accordance with anoperation that is input when a command position in the ultrasound imageis changed. The calculating unit 33 includes a command-positioncoordinates calculating unit 331, a shift-information calculating unit332, and a measurement-points distance calculating unit 333.

The command-position coordinates calculating unit 331 calculates thecoordinates of a command position on the B-mode image that is displayedon a display unit 41, described later, from the contact position on atouch panel 42, described later, based on operating signals.

The shift-information calculating unit 332 calculates the amount ofshift of a B-mode image on the basis of a command position (coordinatescalculated by the command-position coordinates calculating unit 331), adistance that is a distance from the ultrasound transducer 21 and thatis a distance (depth) from the center of an image of the ultrasoundtransducer to the position that corresponds to a command position in theB-mode image, the type of the ultrasound transducer, and the like, andoutputs the calculated amount of shift and the preset shift direction asshift information.

The measurement-points distance calculating unit 333 calculates thedistance between two measurement points in an ultrasound image,confirmed on the basis of a command position (coordinates calculated bythe command-position coordinates calculating unit 331). Furthermore, themeasurement-points distance calculating unit 333 calculates the actualdistance on the basis of the calculated distance between measurementpoints.

Upon receiving command inputs from the operating device 4, thecharacter-image generating unit 34 generates character image dataincluding a character image in which characters that correspond to thecommand inputs, e.g., two measurement points for measuring a distance,are located based on command input positions (coordinates) calculated bythe calculating unit 33. Character image data may include information tobe related to a B-mode image, such as a frame number, in addition to theabove-described character image. The character-image generating unit 34outputs the generated character image data to the image synthesizingunit 35.

The image synthesizing unit 35 generates synthesis image data includinga synthesis image that is a synthesis of a B-mode image and a characterimage by using image data (B-mode image data and character image data)generated by each of the ultrasound-image generating unit 32 and thecharacter-image generating unit 34. Synthesis image data includesinformation such as a frame number in addition to the above-describedsynthesis image.

Upon receiving a command input from the operating device 4, the modesetting unit 36 sets an operation mode that corresponds to the commandinput. Specifically, in accordance with a command input, the modesetting unit 36 sets any operation mode, such as a distance measurementmode, a command input mode, or an enlargement/reduction mode, as aprocessing mode for performing processing on a B-mode image.

The input unit 37 is implemented by using an input button for receivinginput of various types of information to turn on/off the power source,or the like.

The control unit 38 performs overall control on the ultrasound diagnosissystem 1. The control unit 38 is implemented by using a centralprocessing unit (CPU), various arithmetic circuits, or the like, havingcalculation and control functions. The control unit 38 reads, from thestorage unit 39, information stored and saved in the storage unit 39,and performs various calculation operations related to a method ofoperating the ultrasound observation device 10, thereby performingoverall control on the ultrasound observation device 10. Furthermore,the control unit 38 may be configured by using a CPU, or the like, thatis shared by the signal processing unit 31.

The storage unit 39 stores various programs for operating the ultrasounddiagnosis system 1, data including various parameters needed foroperation of the ultrasound diagnosis system 1, and the like.Furthermore, the storage unit 39 includes a shift-information storageunit 391 that stores the amount of shift calculated by theshift-information calculating unit 332 in relation to a command position(coordinates calculated by the command-position coordinates calculatingunit 331), a distance (depth) from the ultrasound transducer, the typeof ultrasound transducer, and the like.

Furthermore, the storage unit 39 stores various programs including anoperation program to implement a method of operating the ultrasounddiagnosis system 1. The operation program may be widely distributed bybeing recorded in a recording medium readable by a computer, such ashard disk, flash memory, CD-ROM, DVD-ROM, or flexible disk. Furthermore,the above-described various programs may be acquired by being downloadedvia a communication network. The communication network mentioned here isimplemented by using, for example, an existing public network, localarea network (LAN), or wide area network (WAN), and it may be wired orwireless.

The storage unit 39 having the above-described configuration isimplemented by using a read only memory (ROM) that has various programs,and the like, previously installed, a random access memory (RAM) thatstores calculation parameters, data, and the like, for each process.

The operating device 4 includes the display unit 41, the touch panel 42(multi-input receiving unit), a display controller 43, and a controlunit 44.

The display unit 41 is configured by using a display panel that is madeof liquid crystal, organic electro luminescence (EL), or the like. Thedisplay unit 41 displays ultrasound images that correspond to B-modeimage data and various types of information related to operation, whichare input via for example the control units 38, 44.

The touch panel 42 is provided on the display screen of the display unit41, and it receives an input that corresponds to the contact position ofan object from outside. Specifically, the touch panel 42 detects a touch(contact) position of a user such as operator in accordance with anoperation icon displayed on the display unit 41, and it outputs theoperating signal including the position (coordinates) that correspondsto the detected touch position to the control unit 44. As the displayunit 41 displays ultrasound images and various types of information, thetouch panel 42 functions as a graphical user interface (GUI). The touchpanel has a resistive layer system, a capacitive system, an opticalsystem, or the like, and a touch panel with any system is applicable.

The display controller 43 controls the display unit 41 so as to displaysynthesis image data generated by the image synthesizing unit 35 afterit is acquired and controls the display unit 41 so as to display a guideimage for input operation through the touch panel 42 and a display imagethat corresponds to an operation mode.

The control unit 44 performs overall control of the operating device 4.The control unit 44 is implemented by using a central processing unit(CPU), various arithmetic circuits, or the like, having calculation andcontrol functions.

Next, with reference to the drawings, an explanation is given of ameasurement process performed by the ultrasound observation device 10 inthe ultrasound diagnosis system 1 having the above-describedconfiguration. FIG. 2 is a flowchart that illustrates a measurementprocess performed by the ultrasound diagnosis system according to thefirst embodiment. Furthermore, an explanation is given below of a casewhere each unit operates in a distance measurement mode for measuringthe distance between designated measurement points under the control ofthe control unit 38.

After the transmitting/receiving unit 30 acquires an echo signal fromthe ultrasound transducer 21 (Step S101), the control unit 38 performscontrol to generate an ultrasound image (here, B-mode image) based onthe echo signal. The signal processing unit 31 and the ultrasound-imagegenerating unit 32 generate B-mode image data including the B-mode imagebased on the acquired echo signal (Step S102: ultrasound-imagegeneration step). Then, the control unit 38 outputs a control signaltogether with the B-mode image data to the operating device 4 so that atleast the display unit 41 displays the generated B-mode image. Thus,under the control of the display controller 43, the display unit 41displays a B-mode image (Step S103). In the following explanation, thedisplay unit 41 displays freeze images; however, live images may bedisplayed.

Then, the control unit 38 determines whether an input (touch input) ofan operating signal has been received from the control unit 44 (thetouch panel 42) (Step S104). If an input of an operating signal has beenreceived (Step S104: Yes), the control unit 38 proceeds to Step S105.Conversely, if an input of an operating signal has not been received(Step S104: No), the control unit 38 repeatedly checks whether anoperating signal has been input.

After receiving an operating signal from the operating device 4, thecontrol unit 38 performs a process to confirm one of the two measurementpoints (command positions) for measurement on the basis of the operatingsignal (Step S105: a first measurement-point confirmation process).Specifically, the calculating unit 33 performs a process to calculate acommand position in accordance with a command input from the touch panel42, while the operating device 4 causes the display unit 41 to display ameasurement point (command position) superimposed on the B-mode image,whereby the process to confirm the measurement point is performed.

FIG. 3 is a flowchart that illustrates the measurement-pointconfirmation process performed by the ultrasound diagnosis systemaccording to the first embodiment, and it is a flowchart thatillustrates the first measurement-point confirmation process at StepS105. FIGS. 4 to 9 are diagrams that illustrate the measurement-pointconfirmation process according to the first embodiment.

First, the command-position coordinates calculating unit 331 calculatesthe coordinates of the contact position (command position) of an object(finger) that is input to the touch panel 42 in accordance with theoperating signal (Step S201, FIGS. 4, 5). As the coordinates of thecommand position, the command-position coordinates calculating unit 331calculates the coordinates of the position with the highest pressure(signal value) within the contact position or the position at the center(center of gravity) of the area touched by the finger (the area to whicha load is applied). For example, when an operating signal is input on aregular basis, the command-position coordinates calculating unit 331calculates the command position (coordinates) each time an input isreceived.

Here, the character-image generating unit 34 may generate characterimage data including a character image (according to the firstembodiment, a character image P₁₁ represented by “X”, see FIG. 5) inaccordance with the coordinates calculated by the command-positioncoordinates calculating unit 331. For example, with regard to thecharacter image P₁₁, character image data is generated to allocate thecharacter image P₁₁ in relation to the coordinates on the B-mode imagesuch that the coordinates of the command position are located at thecenter (intersection point) of the mark “X”. In this case, the imagesynthesizing unit 35 may generate synthesis image data including asynthesis image for display by synthesizing a B-mode image with acharacter image in a superimposed manner.

Then, the shift-information calculating unit 332 calculates the amountof shift of the B-mode image and outputs it as shift information (StepS202: a calculation step). If the ultrasound transducer in use is aradial-type ultrasound transducer, the shift-information calculatingunit 332 generates shift information for rotating a B-mode image withthe center of an image of the ultrasound transducer as a rotationcenter. In this case, the shift information includes a rotationdirection and a rotation angle. For shifting a B-mode image, a direction(depth direction) along the depth from the ultrasound transducer 21 andthe amount of shift in the depth direction as well as rotation may beset, or the control unit 38 may set any of the rotation and the depthdirection in accordance with an input from a user or a command position.

After the shift-information calculating unit 332 generates the shiftinformation, the ultrasound-image generating unit 32 shifts the B-modeimage (ultrasound image) in accordance with the shift information (StepS203: a control step). According to the first embodiment, theultrasound-image generating unit 32 rotates the B-mode image in apredetermined direction by a predetermined amount on the basis of theshift information.

For example, as illustrated in FIG. 5, the ultrasound-image generatingunit 32 rotates the B-mode image by a predetermined amount in a rotationdirection Y_(R). The control unit 38 controls the character-imagegenerating unit 34 so as to generate character image data where acharacter image is located at the position that corresponds to thecommand position on the B-mode image after the rotation process (StepS204: a character-image generation step). Then, the image synthesizingunit 35 synthesizes the B-mode image with the character image in asuperimposed manner, thereby generating synthesis image data including asynthesis image for display (Step S205: a synthesis-image generationstep). Due to this rotation process, the character image P₁₁ (see FIG.5) indicating the command position is moved to a character image P₁₂(see FIG. 6). Thus, on the B-mode image, the character image P₁₂ may belocated at the command position input by the operator, and the characterimage P₁₂ may be displayed without being concealed with the operator'sfinger (see FIG. 7).

Then, the control unit 38 determines whether more than a predeterminedtime period has elapsed while the finger is continuously in contact withthe same position on the touch panel 42 (Step S206). Here, when it isdetermined that the time period during which the finger is continuouslyin contact with the touch panel 42 is shorter than the predeterminedtime period (Step S206: No), the control unit 38 proceeds to Step S208.Conversely, when it is determined that more than the predetermined timeperiod has elapsed while the finger is continuously in contact with thetouch panel 42 (Step S206: Yes), the control unit 38 proceeds to StepS207. Furthermore, in the above explanation, the time period duringwhich the finger is continuously in contact with the same position onthe touch panel 42 is measured; however, this is not a limitation, andfor example a duration time may be measured based on the assumption thatthe finger is continuously in contact with the touch panel 42 if thefinger is continuously in contact within a specified range from thefirst contact position.

At Step S207, a process is performed to enlarge a partial area of theB-mode image including the command position. Here, to change anoperation mode from the distance measurement mode, the control unit 38causes the mode setting unit 36 to change the setting to theenlargement/reduction mode and gives a command to the ultrasound-imagegenerating unit 32 so as to enlarge the image. The ultrasound-imagegenerating unit 32 enlarges the B-mode image by a predeterminedenlargement percentage and inputs the ultrasound image after theenlargement process to the image synthesizing unit 35. Theultrasound-image generating unit 32 may enlarge the image with thecenter position of the B-mode image as a center or may enlarge it withthe command position (i.e., the character image P₁₁) as a center.

After the enlarged B-mode image generated by the ultrasound-imagegenerating unit 32 is input, the image synthesizing unit 35 superimposesthe character image P₁₁ on the enlarged B-mode image in accordance withthe coordinates of the character image P₁₁ superimposed on the B-modeimage before enlargement, thereby allocating the character image P₁₁ onthe enlarged B-mode image (see FIG. 8). Then, the calculating unit 33,the character-image generating unit 34, and the image synthesizing unit35 update a character image (command position) in accordance with anoperating signal input from the touch panel 42. Thus, the position ofthe character image P₁₁ on the B-mode image may be finely adjusted.

Furthermore, in the enlargement/reduction mode, an enlargementpercentage (display magnification) may be changed in accordance withchanges in the contact position on the touch panel 42. For example, athreshold is set for the amount of change in a command position, and thecontrol unit 38 performs control such that, when the amount of change inthe command position exceeds the threshold, the command position ismoved, and when the amount of change is lower than or equal to thethreshold, the enlargement percentage of the B-mode image is changed.For example, when the enlargement/reduction mode is set, the controlunit 38 displays an indicator M on the display unit 41. The control unit38 increases (+) the enlargement percentage when a vector component ofthe direction (move vector) for changing a command position is identicalto a vector (in a vertical direction in the case of FIG. 9) in the “+”direction or the “−” direction of the indicator M beyond a certainlevel, for example, when a vector quantity in an upward direction islarge, a moving velocity in an upward direction is small, or a pressingforce in an upward direction on a contact area is large, and decreases(−) the enlargement percentage when a vector quantity in a downwarddirection is large, a moving velocity in a downward direction is small,or a pressing force in a downward direction on a contact area is large.Furthermore, the minimum value of the enlargement percentage is largerthan zero and it is the least enlargement percentage selected, and animage is enlarged to be larger than the originally displayed B-modeimage. Furthermore, the indicator M may have the “+” direction and the“−” direction in a horizontal direction of an image. When theenlargement percentage is changed in a horizontal direction, the controlunit 38 controls the enlargement percentage based on a vector in thesame direction as the indicator M, the movement distance of a commandposition, and the like.

At Step S208 subsequent to Step S207, the control unit 38 determineswhether an operation has been performed to set a measurement point byconfirming a command position. When an operation has been performed toset a measurement point by confirming the command position (Step S208:Yes), the control unit 38 terminates the measurement-point confirmationprocess and returns to the flowchart in FIG. 2. Conversely, when anoperation has not been performed to set a measurement point byconfirming the command position (Step S208: No), the control unit 38returns to Step S207 and repeatedly performs the above-describedprocess. The operation to confirm a measurement point is performed, forexample, when a command input for confirming a measurement point isreceived, when no operation is performed during a predetermined timeperiod from the time when the finger is released from the touch panel42, and the like.

Furthermore, after the position of one of the two measurement points isconfirmed, the ultrasound-image generating unit 32 may move the B-modeimage such that the position of the B-mode image that corresponds to theposition where the character image P₁₁ (measurement point) is allocatedis located at the center of the display screen of the display unit 41.Here, the character-image generating unit 34 generates character imagedata in which a character image has been moved in accordance with themoved B-mode image, i.e., the character image has been moved to thecenter.

Furthermore, in the explanation, the trigger for shifting to theenlargement mode is a duration time of touch at the same position;however, it may be the moving velocity of a finger (command position), acontact pressure to the touch panel 42, the combination thereof, tap,double tap, or the like. For example, if the moving velocity is atrigger, it is assumed that a command position is moved to a fartherposition as it is higher and a command position is moved to a closerposition as it is lower, and a control is performed such that atransition is made to an enlargement mode when the moving velocity islow. Furthermore, when a transition is made to the enlargement mode dueto single tap, double tap, or the like, the control unit 38 may performcontrol so as to make enlargement when double tap is conducted and makereduction when single tap is conducted. Users may previously registerand edit operation performed to change the enlargement percentage.

With reference back to the flowchart in FIG. 2, after one measurementpoint is confirmed at Step S105, the control unit 38 determines whetheran input (touch input) of a new operating signal has been received fromthe control unit 44 (the touch panel 42) (Step S106). When it isdetermined that an input (touch input) of a new operating signal hasbeen received (Step S106: Yes), the control unit 38 proceeds to StepS107. Conversely, when no input of a new operating signal has beenreceived (Step S106: No), the control unit 38 repeatedly checks whetheran operating signal has been input.

After receiving an operating signal from the operating device 4, thecontrol unit 38 performs a process to calculate and display a firstcommand position based on the operating signal (Step S107: a secondmeasurement-point confirmation process). Specifically, the calculatingunit 33 performs a process to calculate the other one of the twomeasurement points (command positions) for measurement in accordancewith a command input from the touch panel 42, and the operating device 4causes the display unit 41 to display the measurement point (commandposition) superimposed on the B-mode image. The process to calculate anddisplay the measurement point (command position) is the same as theflowchart illustrated in FIG. 3.

FIG. 10 is a diagram that illustrates the measurement-point confirmationprocess according to the first embodiment, and it is a diagram thatillustrates the second measurement-point confirmation process at StepS107. At Step S107, when a command is input to the touch panel 42 due tothe contact of the operator's finger, the display screen illustrated inFIG. 10 displays the B-mode image and a character image P₂₁, for which aposition has been calculated in accordance with the command input and arotation process has been performed on the B-mode image, in addition tothe measurement point (the character image P₁₂) confirmed at Step S105on the B-mode image.

FIG. 11 is a diagram that illustrates the measurement-point confirmationprocess according to the first embodiment, and it is a diagram thatillustrates the measurement points confirmed at Step S105 and S107.After the measurement point is confirmed at Step S107, the displayscreen illustrated in FIG. 11 displays the character image P₁₂ confirmedat Step S105 and a character image P₂₂ confirmed at Step S107 in asuperimposed manner on the B-mode image.

After the positions (coordinates) of the two measurement points (thecharacter images P₁₂, P₂₂) are calculated, the measurement-pointsdistance calculating unit 333 calculates the distance between thecharacter images P₁₂ and P₂₂ and displays it on the display unit 41(Step S108). The measurement-points distance calculating unit 333calculates the length of the line segment connecting the characterimages P₁₂, P₂₂ and calculates the actual value (A: 2.0 mm illustratedin FIG. 11) based on the calculated length. Then, the control unit 38controls the display unit 41 so as to display the calculated actualvalue. Furthermore, the display device 5 may display the calculateddistance between the measurement points and the actual value.

At Step S109 subsequent to Step S108, the control unit 38 determineswhether a measurement termination command for the measurement-pointconfirmation process has been input. The control unit 38 determineswhether the operating device 4 has received input of the measurementtermination command and, when the operating device 4 has received inputof the measurement termination command (Step S109: Yes), terminates themeasurement process. Conversely, if the input unit 37 or the operatingdevice 4 has not received input of the measurement termination command(Step S109: No), Step S103 is returned, and the above-described processis repeated. The measurement termination command includes, for example,a case where a command for terminating the distance measurement mode hasbeen input, a case where no operation has been received during apredetermined time period, and the like.

Furthermore, with the above-described flow, an explanation is given of acase where the display unit 41 in the operating device 4 displayssynthesis images; however, the display device 5 may display similarimages, or the display device 5 may display only B-mode images duringthe measurement process. Furthermore, images displayed by the displayunit 41 and the display device 5 may be identical or different images.The display device 5 may display not ultrasound images but measurementpoints only to make it possible to select whether an image is to berotated, moved, or displayed in an enlarged manner.

According to the first embodiment described above, after a commandposition (coordinates) on a B-mode image is calculated in accordancewith the contact position of the finger on the touch panel 42, theB-mode image is rotated, and the character image P₁₂ is allocated at theposition that corresponds to the command position in the B-mode image,whereby with regard to the position (the character image P₁₁) specifiedby an operator, or the like, the character image P₁₂ is allocated inaccordance with the position intuitively specified by the operator, andthe visibility of the character image P₁₂ is retained without beinghidden by the finger of the operator so that the operability regarding acommand input of a command point on an ultrasound image (B-mode image)may be improved.

Furthermore, in the explanation according to the above-described firstembodiment, two command positions are input at different timing inchronological order when a touch is made with one finger and then atouch is made with another finger; however, two command positions may beinput by simultaneously touching the touch panel 42 with two fingers.When two command positions are simultaneously input, each measurementpoint is confirmed on the basis of each command position (contactposition).

Furthermore, in the explanation according to the above-described firstembodiment, a B-mode image is enlarged in the enlargement mode; however,the range for generating a B-mode image may be changed. When a B-modeimage is enlarged, a partial area of the ultrasound image (B-mode image)generated by the ultrasound-image generating unit 32 is clipped andenlarged. However, when a B-mode image is enlarged by changing therange, ultrasonic waves are transmitted in accordance with the changedrange, ultrasound echoes reflected by an observation target areacquired, and a B-mode image with the changed range is generated by theultrasound-image generating unit 32. The subsequent process is the sameas the above-described process. As described above, when the range ischanged, the amount of change is set based on a touch duration time, thenumber of times touch is detected, and a preset amount of change.

Modification 1 of the First Embodiment

FIG. 12 is a diagram that illustrates a measurement-point confirmationprocess according to a modification 1 of the first embodiment. Accordingto the above-described first embodiment, a radial-type ultrasoundtransducer is explained as an example; however, this is not alimitation, and a convex-type and a linear-type ultrasound transducersare applicable. For example, as illustrated in FIG. 12, in the case of aconvex-type ultrasound transducer, when a command position is input, aB-mode image is shifted in at least one direction of the display screen,i.e., an upward direction, a downward direction, a leftward direction,or a rightward direction, so that a control is performed such that acharacter image P₃₁ indicating the command position is not hidden by afinger of the operator. FIG. 12 illustrates an example where a B-modeimage is shifted to a position in combination of the upward directionand the leftward direction and the character image P₃₁ is superimposedon the shifted B-mode image.

Furthermore, the control unit 38 is capable of identifying the type ofthe ultrasound transducer 21 provided in the ultrasound probe 2connected to the processing device 3, and the shift-informationcalculating unit 332 generates shift information in accordance with theidentified ultrasound transducer. The storage unit 39 stores theinformation for identifying the ultrasound transducer, and the controlunit 38 acquires unique information from the connected ultrasound probe2 and identifies the type of the ultrasound transducer provided in theconnected ultrasound probe 2 on the basis of the acquired uniqueinformation and the information stored in the storage unit 39.

Modification 2 of the First Embodiment

Furthermore, a radial-type ultrasound transducer may shift synthesisimages in upward, downward, rightward, and leftward directions of thescreen as in the above-described modification 1. FIGS. 13 and 14 arediagrams that illustrate the measurement-point confirmation processaccording to a modification 2 of the first embodiment, and they arediagrams that illustrate shifted synthesis images. According to themodification 2, a slide direction of the synthesis image is changed inaccordance with the depth of a command position from the ultrasoundtransducer.

For example, when the position of the character image (command position)is a position with a small depth from the ultrasound transducer like acharacter image P₁₄ illustrated in FIG. 13, the B-mode image is slid inan upper left direction of the display screen and a character image P₁₅is displayed. Conversely, when the position of the character image(command position) is a position with a large depth from the ultrasoundtransducer like a character image P₁₆ illustrated in FIG. 14, the B-modeimage is slid in an upward direction of the display screen and acharacter image P₁₇ is displayed. In this manner, shifting due tosliding as well as shifting due to rotation may be conducted, and ashift direction may be changed in accordance with a depth.

Modification 3 of the First Embodiment

FIG. 15 is a diagram that illustrates a measurement-point confirmationprocess according to a modification 3 of the first embodiment. Accordingto the above-described first embodiment, an explanation is given of, forexample, the configuration for enlarging a B-mode image while thedisplay position of the character image P₁₁ is kept; however, this isnot a limitation, and an enlarged image may be displayed on a differentdisplay area. For example, as illustrated in FIG. 15, a display area Rfor displaying an enlarged image is provided to display a synthesisimage where a character image P₁₃ is allocated on the enlarged B-modeimage. Furthermore, the character image P₁₃ on the B-mode image at thedisplay area R is located at the position that corresponds to thecharacter image P₁₁, and when the character image P₁₁ is moved, theposition of the character image P₁₃ is accordingly changed. Furthermore,when the character image P₁₃ is out of the display area R due tomovement of the character image P₁₁, the enlarged area of the B-modeimage is changed to a partial area so that the character image P₁₃ isdisplayed on the display area R.

Second Embodiment

Next, with reference to a drawing, an explanation is given of a secondembodiment. FIG. 16 is a block diagram that illustrates theconfiguration of an ultrasound diagnosis system according to the secondembodiment. FIG. 17 is a diagram that illustrates a character-imagedisplay process according to the second embodiment. According to thesecond embodiment, to improve the visibility of character images, twocharacter images are rotated in accordance with location of thecharacter images.

In an ultrasound diagnosis system 1A according to the second embodiment,as compared with the configuration of the above-described ultrasounddiagnosis system 1, a calculating unit 33 a in a processing device 3Afurther includes an overlap determining unit 334. The overlapdetermining unit 334 determines whether two character images areoverlapped with the line segment connecting the two character images.

When two character images (character images P₅₁, P₅₂) are displayed inaccordance with two measurement points that are set for distancemeasurement, a line segment L₁ connecting the character images P₅₁, P₅₂is sometimes overlapped with the character images P₅₁, P₅₂, asillustrated in a part (a) of FIG. 17. In this case, the visibility ofthe center positions of the character images P₅₁, P₅₂ and the edges ofthe line segment L₁ are reduced.

According to the second embodiment, the overlap determining unit 334determines whether a character image and a line segment are overlappedon the basis of the shape of the character image and the direction towhich the line segment extends. The overlap determining unit 334determines that the line segment L₁ connecting the character images P₅₁,P₅₂ are overlapped with the character images P₅₁, P₅₂, theshift-information calculating unit 332 generates shift informationindicating that the character images are to be rotated, and thecharacter-image generating unit 34 rotates the character images P₅₁, P₅₂and generates character images P₅₃, P₅₄ that are not overlapped with theline segment L₁, as illustrated in a part (b) of FIG. 17. For example,the character-image generating unit 34 rotates a character image by 45°with the center of the character image as a rotation center, therebygenerating character image data. Furthermore, in accordance with thepositional relationship between the character images P₅₁, P₅₂, rotationmay be made such that the line segment L₁ always passes through thecenter of the two perpendicular straight lines of the character imagesP₅₁, P₅₂.

According to the second embodiment described above, the advantage of theabove-described first embodiment may be obtained, and when the overlapdetermining unit 334 determines that the line segment L₁ connecting thecharacter images P₅₁, P₅₂ is overlapped with the character images P₅₁,P₅₂, the character-image generating unit 34 rotates the character imagesP₅₁, P₅₂ or rotates them such that, in accordance with the positionalrelationship between the character images P₅₁, P₅₂, the angle madebetween the line segments of the character images P₅₁, P₅₂ (twoperpendicular straight lines) and the line segment L₁ is always 45° sothat the generated character images P₅₃, P₅₄ are not overlapped with theline segment L₁, whereby it is possible to prevent a reduction in thevisibility of the center of a character image and the edges of ameasurement range.

Furthermore, in the explanation according to the above-described secondembodiment, the character images P₅₁, P₅₂ are rotated to change theshapes of the character images; however, when the overlap determiningunit 334 determines that they are overlapped, a character image may bechanged from “X” to a triangle, a circle, or the like.

Third Embodiment

Next, a third embodiment is explained with reference to drawings. FIG.18 is a block diagram that illustrates the configuration of anultrasound diagnosis system according to the third embodiment. Accordingto the third embodiment, to improve the visibility of character images,the line of sight of an operator is detected, and a character image isshifted in accordance with a detection result.

In an ultrasound diagnosis system 1B according to the third embodiment,as compared with the configuration of the above-described ultrasounddiagnosis system 1, a calculating unit 33 b of a processing device 3Bfurther includes an NUI recognizing unit 335, and an operating device 4Afurther includes a natural user interface (NUI) 45. The NUI 45 capturesfor example the upper half of the body of an operator and outputsidentification information for identifying an eye (the line of sight) ora finger. On the basis of identification information from the NUI 45,the NUI recognizing unit 335 detects the direction of the line of sightof the operator or detects whether the hand touching the touch panel 42is a right hand or a left hand and outputs it to the shift-informationcalculating unit 332. The NUI recognizing unit 335 compares the obtainedelectric signal with feature data to recognize the direction of the lineof sight or a right hand or a left hand.

FIGS. 19, 20 are diagrams that illustrate a measurement-pointconfirmation process according to the third embodiment. For example,when the NUI recognizing unit 335 obtains a recognition result such thatthe hand touching the touch panel 42 is a right hand and the directionof the line of sight is an N₁ direction, the shift-informationcalculating unit 332 sets a shift direction such that the characterimage is moved to the left side that is the side of the thumb and thefront of the line of sight. In FIG. 19, the shift direction is set in adirection (an arrow Y₁ in FIG. 19) along which the character image ismoved to the upper left. Thus, as illustrated in FIG. 19, a characterimage P₆₁ is an image displayed on the upper left of the fingertip.

Furthermore, when the NUI recognizing unit 335 obtains a recognitionresult such that the hand touching the touch panel 42 is a left hand andthe direction of the line of sight is an N₂ direction, theshift-information calculating unit 332 sets a shift direction such thatthe character image is moved to the right side that is the side of thethumb and the front of the line of sight. In FIG. 20, the shiftdirection is set in a direction (an arrow Y₂ in FIG. 20) along which thecharacter image is moved to the upper right. Thus, as illustrated inFIG. 20, a character image P₆₂ is an image displayed on the upper rightof the fingertip.

According to the third embodiment described above, the advantage of theabove-described first embodiment may be obtained, and the NUIrecognizing unit 335 detects the direction of the line of sight of anoperator and detects whether the hand touching the touch panel 42 is aright hand or a left hand on the basis of identification informationfrom the NUI 45, and the shift-information calculating unit 332determines a shift direction in accordance with the direction of theline of sight and the hand so that a character image is allocated basedon the position that is intuitively designated by the operator and thevisibility of the character image is retained, whereby the operabilitywith regard to a command input for a command point on an ultrasoundimage (B-mode image) may be further improved.

Furthermore, in the explanation according to the above-described thirdembodiment, the NUI 45 outputs identification information foridentifying an eye (the line of sight) or a hand; however, at least oneof the line of sight and a hand may be detected.

Furthermore, in the explanation according to the first to the thirdembodiments and the modifications described above, the observationtarget is for example a living tissue; however, industrial-useendoscopes for observing the characteristics of a material are alsoapplicable. The ultrasound observation device according to the presentdisclosure is applicable regardless of whether it is inside or outside abody. Moreover, not only ultrasonic waves but also infrared rays, or thelike, may be emitted to transmit and receive signals of the observationtarget.

Furthermore, in the explanation according to the first to the thirdembodiments and the modifications described above, the distance betweentwo measurement points is measured; however, when the measurement targetis a circle, or the like, and an area is measured, a measurement pointmay be regarded as the diameter of the circle, and the diameter of thecircle as the measurement target may be set by operation on the touchpanel. Moreover, when an ellipse is set rather than a circle, any one ofthe short axis and the long axis calculated at a predeterminedpercentage may be input through the touch panel 42. For example, notonly measuring the distance between two measurement points, but also anoperation target position may be determined on the basis of input of onepoint or three or more points.

Thus, the present disclosure may include various embodiments withoutdeparting from the technical idea disclosed in claims.

According to the present disclosure, there is an advantage such thatoperability with regard to a command input of a command point on anultrasound image may be improved.

Additional advantages and modifications will readily occur to thoseskilled in the art. Therefore, the disclosure in its broader aspects isnot limited to the specific details and representative embodiments shownand described herein. Accordingly, various modifications may be madewithout departing from the spirit or scope of the general inventiveconcept as defined by the appended claims and their equivalents.

What is claimed is:
 1. A processing device comprising a controllercomprising hardware, wherein the controller is configured to execute:generating an ultrasound image based on an ultrasound signal acquired byan ultrasound probe, the ultrasound probe being configured to transmitan ultrasonic wave to a subject that is an observation target andreceive an ultrasonic wave reflected by the subject; generating shiftinformation including a shift direction of a display area of theultrasound image displayed on a display unit in accordance with acommand position with respect to the ultrasound image; shifting theultrasound image in accordance with the shift information; andgenerating a character image indicating an area targeted for a processperformed on the ultrasound image in relation to the command position inthe ultrasound image after being shifted.
 2. The processing deviceaccording to claim 1, wherein the controller is configured to furtherexecute generating a synthesys image by synthesizing the ultrasoundimage and the character image.
 3. The processing device according toclaim 1, wherein the controller is configured to execute changing adisplay magnification of the ultrasound image displayed on the displayunit or a range for generating the ultrasound image, in accordance witha behavior of a command position of the area targeted for a processperformed on the ultrasound image during a duration time of touch on atouch panel provided on a display surface of the display unit, the touchpanel including a contact surface with which a finger of an operator isbrought into contact, and receiving an input that corresponds to acontact position of the finger as the command position.
 4. Theprocessing device according to claim 3, wherein the controller isconfigured to execute, when the display magnification of the ultrasoundimage or the range for generating the ultrasound image is changed,enlarging a partial area of the ultrasound image including the commandposition and displaying the enlarged partial area on the display unit.5. The processing device according to claim 3, wherein the behavior ofthe command position during a duration time of touch on the touch panelis a duration time of touch on an identical command position, and thecontroller is configured to execute changing the display magnificationof the ultrasound image on the display unit or the range for generatingthe ultrasound image when the duration time of touch is a predeterminedtime period or more.
 6. The processing device according to claim 1,wherein the controller is configured to execute changing a displaymagnification of the ultrasound image displayed on the display unit or arange for generating the ultrasound image in accordance with number oftimes touch on the touch panel is detected.
 7. The processing deviceaccording to claim 1, wherein the controller is configured to executesetting a shift direction of the display area of the ultrasound image inaccordance with a type of a ultrasound transducer that is provided inthe ultrasound probe connected to the processing device.
 8. Theprocessing device according to claim 1, wherein the controller isconfigured to execute: identifying a type of the ultrasound probeconnected to the processing device; and setting a shift direction of thedisplay area of the ultrasound image in any of a rotation direction anda depth direction of the ultrasound transducer when the ultrasound probeconnected to the processing device includes a radial-type ultrasoundtransducer.
 9. The processing device according to claim 1, wherein thecontroller is configured to execute: Identifying a type of theultrasound probe connected to the processing device; and setting a shiftdirection of the display area of the ultrasound image in at least one ofupward, downward, rightward, and leftward directions of a display screenof the display unit when the ultrasound probe connected to theprocessing device includes a convex-type ultrasound transducer.
 10. Theprocessing device according to claim 7, wherein the controller isconfigured to execute setting a shift direction of the display area ofthe ultrasound image in accordance with the command position and a depththat is a depth from the ultrasound transducer and that is a depth froman image of the ultrasound transducer in the ultrasound image to aposition that corresponds to the command position.
 11. The processingdevice according to claim 1, wherein the controller is configured toexecute: measuring a distance between two command positions designatedin the ultrasound image through the touch panel; and generating theultrasound image in which, after input of one of the two commandpositions is terminated, a position of the ultrasound image thatcorresponds to the one of the command positions is located at a centerof a display screen of the display unit.
 12. The processing deviceaccording to claim 1, wherein the controller is configured to executesetting a shift direction of the display area of the ultrasound image inaccordance with a detection result of a detector configured to detect atleast one of a finger and a line of sight of an operator who operatesthe touch panel.
 13. The processing device according to claim 11,wherein the controller is configured to execute changing the characterimage in accordance with a positional relationship between characterimages that correspond to the two command positions.
 14. A method ofoperating a processing device, comprising: generating an ultrasoundimage based on an ultrasound signal acquired by an ultrasound probe, theultrasound probe being configured to transmit an ultrasonic wave to asubject that is an observation target and receive an ultrasonic wavereflected by the subject; generating shift information including a shiftdirection of a display area of the ultrasound image displayed on adisplay unit in accordance with a command position with respect to theultrasound image; shifting the ultrasound image in accordance with theshift information; and generating a character image indicating an areatargeted for a process performed on the ultrasound image in relation tothe command position in the ultrasound image after being shifted.
 15. Anon-transitory computer-readable recording medium on which an executableprogram is recorded, the program instructing a processor to execute:generating an ultrasound image based on an ultrasound signal acquired byan ultrasound probe, the ultrasound probe being configured to transmitan ultrasonic wave to a subject that is an observation target andreceive an ultrasonic wave reflected by the subject; generating shiftinformation including a shift direction of a display area of theultrasound image displayed on a display unit in accordance with acommand position with respect to the ultrasound image; shifting theultrasound image in accordance with the shift information; andgenerating a character image indicating an area targeted for a processperformed on the ultrasound image in relation to the command position inthe ultrasound image after being shifted.